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(54) IMAGE SYNTHESIZER 
(57)Abstract: 

PURPOSE: To provide an image synthesizer capable of syntheizing plural 
systems of images whose pixel aspect ratios are different from each other and 
displaying pictures with aspect ratios required by respective images. 
CONSTITUTION: This device is provided with an aspect ratio conversion means 
4 converting 15 dots in the horizontal direction to 14 dots for the moving image 
data 3a of e.g. horizontal 71 1 , vertical 487 dots (aspect ratio 4:3 of a reproducing 
picture and aspect ratio 1.072 of a reproducing pixel are assumed) outputted 
from a moving image reproducing device 3. The device is provided with a 
synthesis means 5 selecting either one side between the image data 10a 
delaying the computer image data 2a of e.g. horizontal 640, vertical 480 dots 
(pixel aspect ratio 1) outputted from a computer image reproducing device 2 and 



the aspect ratio converted moving image data 4a based on synthesis range 
specifying information 5b and generating an image synthesis output 5a, and the 
image synthesis output 5a is converted into an analog video signal 6a by a D/A 
converter 6, and a synthesis image is reproduced on a monitor display device 7. 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer. So the translation may not 

reflect the original precisely. 

2.**** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 

CLAIMS 

[Claim(s)] 

[Claim 1]An image compositing device which compounds a range as which each 
picture was specified in order to intermingle and display video and computer 
graphics characterized by comprising the following all over the same screen. 



An aspect ratio conversion method which performs aspect ratio conversion to 
video. 

video and computer graphics to which aspect ratio conversion was performed -- 
inner -- an image compositing means which generates a picture combined by 
choosing either. 

[Claim 2]The image compositing device according to claim 1, wherein said 
aspect ratio conversion method changes 15 lateral dots into 14 dots. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Industrial Application]For example, the aspect ratio of the pixel of a reproduced 
image assumes except 1 :1 , an MPEG system this invention Dynamic image data, 
It is related with the image compositing device which enabled it to display the 
picture of the aspect ratio which combined the pictures supposing a different 
pixel aspect ratio in case the aspect ratio of the pixel of a reproduced image 
compounds the computer graphics data supposing 1:1, and each picture meant 



on the same screen. 
[0002] 

[Description of the Prior Art]Digitization of the device treating a picture is being 
enhanced in recent years. It roughly divides into the device treating a picture, 
and there are two kinds of things. One is a device involved in the broadcast 
represented by television, video, etc., and another is a computer. These had 
different history and have completely grown up to be a basis of a separate 
standard. By progress of art, development of the device which unites these has 
been attained also on the public welfare level in recent years. However, these 
had completely become a ******** graphics format from the circumstances of that 
breeding to another standard, and it was indispensable to two fusion to have 
absorbed the difference in this standard. 

[0003]The most typical thing to the digital standard represented by broadcast is 
a standard called REC601 of CCIR. This standard samples the luminance signal 
Y by pixel rate 13.5MHz, and the color-difference signal Cb and the thing which 
sampled Cr at 6.25 MHz of that half are to foundations. When this is applied to 
the broadcasting standard of NTSC, 711 dots wide and 487 dots long will be 
displayed on a screen with the aspect ratio 4:3 (aspect ratio of a reproduced 
image), and the aspect ratio (it is described as a pixel aspect ratio below) of 
each pixel of a reproduced image becomes longwise 1.095= {(3/487) /(4/711)}. 



This is a case where it displays on the television of usual NTSC by an overscan 
by an interlace. 

[0004]When the direction of a computer is usually displayed on the monitor of 
VGA (VIDEO GRAPHICS ARRAY) by an under scan on the other hand, 640 
dots wide and 480 dots long will be displayed on a screen with the aspect ratio 
(aspect ratio of a reproduced image) 4:3 by pixel rate 25.175MHz, and the pixel 
aspect ratio has become 1.0= {(3/480) /(4/640)} and a square pixel. In 
reproducing the picture of a computer on television of NTSC system, it becomes 
a pixel aspect ratio of 1.095/(1 3.5-MHz x 2/25.175 MHz) =1.021. If the picture of 
REC601 standard is displayed on the monitor display of a computer, a pixel 
aspect ratio will be set to 1.095/1.021=1.072. If the above is summarized, it will 
become as it is shown in Table 1. 



[0005] 
[Table 1] 
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[0006]ln the device which unites these conventionally, since these were 
reproduced with the clock by the side of the same computer, there was a fault 
that the picture of the animation currently made from the standard for broadcast 
from the first was displayed oblong. 

[° 007 ]!?!l^iQiLA_, is a block lineblock diagram of the conventional image 
compositing device. The conventional image compositing device 100 assumes 
the computer monitor as the monitor display device 106. The video playback 
equipment 101 outputs the image data 101a of each pixel one by one 
synchronizing with the 25.175-MHz reference clock MCK supplied from the 
reference clock generating circuit 102. Since the output of this image data 101a 
is made for REC601 originally which is outputted at 27 MHz, it is equivalent to 
the lower right column of Table 1, and assumes the pixel aspect ratio 1.072. 
When outputting this at 25.175 MHz actually, a pixel aspect ratio is set to 1.0 and 
will display by 1.0 what should be correctly displayed by the pixel aspect ratio 
1.072 as a result. This will look more nearly oblong than original, and if the error 
is said by a ratio, it can also be 7% to 0.932 (=1.0/1.072=25.172/27). On the 
other hand, from the computer graphics playback equipment 103, the image 
data 103a of each pixel which assumed the pixel aspect ratio 1.0 synchronizing 
with the above-mentioned reference clock MCK is outputted one by one. Since 
this displays by 1.0 what was originally made from the pixel aspect ratio 1.0, it 



looks normal. The image compositing means 104 is based on the synthetic 
range specification information 104b, shifts, chooses that image data 101a and 
103a, and supplies it to D/A converter 105. The analog video signal 105a 
outputted from D/A converter 105 is supplied to the monitor display device 106 
of a computer, and image restoration is made. 
[0008] 

[Problem(s) to be Solved by the InventionJHowever, the conventional image 
compositing device 100 only carries out a selection change, and only 
compounds two kinds of image data from which the pixel aspect ratio currently 
assumed differs. For this reason, when the compound image data 104a is 
displayed on the monitor display device 106 of a computer, the screen from the 
video playback equipment 101 will look oblong 7%. It will be sensed general that 
human being's eyes will notice that difference if the ratio of this error exceeds 3%, 
and their aspect ratio of a reproduced image is amusing. 
[0009]lt was made in order that this invention might solve such a technical 
problem, and aspect ratio conversion is performed to the video side, and it aims 
at providing the picture reproducer which can carry out a repeat display in the 
state of the picture which originally meant the image composing of video and 
computer graphics. 
[0010] 



[Means for Solving the Problem]An image compositing device applied to this 
invention in order that this invention may solve said technical problem is 
characterized by that a device compounded so that video and computer 
graphics may be intermingled and displayed all over the same screen 
comprises: 

An aspect ratio conversion method which performs aspect conversion to video. 
An image compositing means which compounds video in which aspect ratio 
conversion was performed, and computer graphics. 

[0011]Composition which changes 15 lateral dots into 14 dots is preferred for an 

aspect ratio conversion method. 

[0012] 

[Function]An aspect ratio conversion circuit performs aspect ratio conversion so 
that the aspect ratio of a reproduced image may become almost equal to the 
aspect ratio of an original image, when it displays by the aspect ratio which 
approximated the aspect ratio of the reproduction pixel which video assumes to 
the aspect ratio which is the reproduction pixel which computer graphics 
assumes, The image data for every pixel by which aspect ratio conversion was 
carried out is outputted. Therefore, the dynamic image data and computer 
graphics data by which aspect conversion was carried out are switched 



selectively, and the composite display of the picture of the aspect ratio whose 
intention video originally has is carried out by combining and displaying two 
kinds of pictures. 

[0013]By using the aspect ratio conversion method of composition of changing 
15 dots of the transverse direction of video into 14 dots, For example, by the 
screen aspect ratio 4:3 specified by REC601 standard of CCIR 711 dots wide 
and 487-dot-long image data (pixel aspect ratio 1.072), It is convertible for 664 
dots wide and 487-dot-long image data (pixel aspect ratio 1.001) by the screen 
aspect ratio 4:3. In this case, although an aspect ratio conversion method is 
comparatively simple composition of conversion to 14 dots from 15 dots, the 
error of the aspect ratio to the pixel aspect ratio 1 .0 which the computer graphics 
side assumes is only 0.1%, and does not produce a problem at all on vision. 
[0014]When changing the aspect ratio of a pixel, an error changes by the ratio. 
When changing the video of REC601 standard into the computer graphics 
supposing the pixel aspect ratio 1.0 (square pixel), the ratio which should be 
changed is 27/25.175=1.072. N: Optimal M and error are decided by N to each 
natural number noting that it changes into M. It is this at the time of 1 .072xN/M>1 , 
and, specifically, defines by the reciprocal at the time of 1.072xN/M<1. Table 2 
shows optimal M and error over each N. In this table 2, an error shows that the 
minimum appears in a certain constant period. 
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[0016]As mentioned above, since a gap of the aspect ratio is permissible if this 
error is less than 3%, if N is 11 or more, the standard of less than 3% of an error 



will be met by human being's eyes. If N is set up greatly, an error can be made 
small, but if N is large, the hardness for aspect ratio conversion and a software 
configuration will become complicated. Then, if an error adopts as the beginning 
N= 15 which becomes small, and M= 14 or more by 11, an error can also do N 
small, without complicating hard structure. When referred to as N= 15 and M= 14, 
an error is 0.1% and 0.1% of this error does not become a problem at all on 
human being's vision characteristics. 
[0017] 

[Example]Hereafter, the example of this invention is described based on an 
accompanying drawing. Drawing 1 is a block lineblock diagram of the image 
compositing device concerning this invention. Also in this case, the monitor 
display device 7 assumes the monitor of a computer. The computer graphics 
playback equipment 2 for which this image compositing device 1 outputs 640 
dots wide and the 480-dot-long computer graphics data 2a for example, the 
aspect ratio of the reproduced image assumed the pixel aspect ratio 1.0 by 4:3, 
The video playback equipment 3 which outputs 711 dots wide and the 487 dots 
(equivalent to REC601 standard of CCIR)-long dynamic image data 3a for 
example, the aspect ratio of the reproduced image assumed the pixel aspect 
ratio 1.072 by 4:3, It consists of the aspect ratio conversion method 4 which 
changes 15 lateral dots into 14 dots, and the image compositing means 5. 



[0018]The composite-image-data output 5a of the image compositing means 5 is 
changed into the analog video signal 6a with D/A converter 6, and is supplied to 
the monitor display device 7 of a computer, and a picture is reproduced by the 
screen of this monitor display device 7. 

[0019]The reference clock MCK with a frequency of 25.175 MHz by which it was 
generated in the reference clock generating circuit 8 provided with the crystal 
oscillator etc. is supplied to the computer graphics playback equipment 2. The 
computer graphics playback equipment 2 outputs the image data 2a of each 
pixel in order of the pixel beforehand set up synchronizing with this reference 
clock MCK (for example, non-interlace). 

[0020]PLL circuit 9 generates a reference clock and the video reproduction clock 
9a which was able to take the synchronization by considering the reference 
clock MCK with a frequency of 25.175 MHz as an input on the frequency of 27 
MHz which carried out double [ of this reference clock MCK ] (858/800), and 
supplies it to the video playback equipment 3. 

[0021 ]The video playback equipment 3 outputs the image data 3a of each pixel 
in order of the pixel beforehand set up synchronizing with the video reproduction 
clock 9a with a frequency of 27 MHz (for example, non-interlace). 
[0022]The block lineblock diagram in which OjBwJnc[2_shows one example of an 
aspect ratio conversion method, and drawing 3 are the explanatory views 



showing operation of an aspect ratio conversion method. The numerals 41 
shown in drawjng_2_are aspect ratio converters, and become operation like 
. The numerals 42 are FIFO (image data temporary storage means of 
first-in first-out composition), are written in by the FIFO writing control part 43, 
and are read by the FIFO reading control part 44. Drawing 3 is the operation 
timing of the aspect ratio converter 41, and subsequent data is sent from the 
video playback equipment 3 from YO every 27 MHz. In the aspect converter 41 , 
linear interpolation which is in the column of calculation of this is calculated. This 
is repeated although orawjng_3_is a conversion table for 15 pieces. In the start of 
this conversion, take out the start signal 41a to the FIFO writing control part 43, 
and in the FIFO writing control part 43. As it is in the column of the FIFO writing 
of drawing 3 , it counts from there and the data for 14 pieces is written in FIF042, 
and as one data is not written in FIF042, it performs aspect conversion of 15:14. 
The FIFO reading control part 44 reads data from FIF042 so that it may send to 
the image compositing means 5 synchronizing with the data from the computer 
graphics playback equipment 2. 

[0023]The image compositing means 5 shown in drawing 1 either of the image 
data 10a which delayed the image data 2a outputted from the image data 4a or 
the computer graphics playback equipment 2 by which aspect ratio conversion 
was carried out via the delay means 10, It is made to synchronize with the 



reference clock MCK, and it constitutes so that it may choose and output. The 
synthetic range specification information 5b on which picture is chosen in which 
range to each picture is supplied from the synthetic range specification means 
which is not illustrated. 

[0024]The delay means 10 interposed between the computer graphics playback 
equipment 2 and the image compositing means 5, The computer graphics data 
10a which delayed transfer of the computer graphics data 2a by the time which 
takes the dynamic image data 3a to carry out aspect conversion, and was 
delayed is outputted, and it constitutes, for example from a temporary storage 
means of first-in first-out (FIFO) composition, etc. 

[0025]Since it is the above composition, 711 dots wide supposing the pixel 
aspect ratio 1.072 outputted from the video playback equipment 3, and the 
487-dot-long dynamic image data 3a, Via the aspect ratio conversion method 4, 
a pixel aspect ratio when it displays by the aspect ratio 4:3 of a reproduction 
screen by 664 dots wide and 487 dots long is changed into the dynamic image 
data 4a equivalent to 1.001, and is supplied to the image compositing means 5. 
Therefore, the image compositing means 5 can generate the picture complex 
data output 5a only by choosing and outputting either between the two image 
data 10a and 4a based on the synthetic range specification information 5b. 
[0026]And the picture complex data output 5a outputted from the image 



compositing means 5 synchronizing with the reference clock MCK is changed 
into the analog video signal 6a with D/A converter 6, and is reproduced with the 
monitor display device 7. The dynamic image data 3a supposing the pixel aspect 
ratio 1.072 outputted from the video playback equipment 3, Since it compounds 
by the image compositing means 5 after carrying out aspect conversion to the 
image data 4a of the pixel aspect ratio 1.001 almost near the pixel aspect ratio 
1.0 which the computer graphics playback equipment 2 assumes via the aspect 
ratio conversion method 4, The image composing of each picture is reproduced 
based on the aspect ratio which each picture originally meant. 
[0027] 

[Effect of the lnvention]The image compositing device applied to this invention 
as explained above, Aspect ratio conversion is performed so that the aspect 
ratio of a reproduced image may become almost equal to the aspect ratio of an 
original image, when it displays by the aspect ratio which approximated the 
aspect ratio of the reproduction pixel which video assumes to the aspect ratio 
which is the reproduction pixel which computer graphics assumes, Since it had 
composition which compounds and displays the video and computer graphics 
which carried out aspect ratio conversion by an image compositing means, each 
picture can reproduce the image composing of each picture based on the aspect 
ratio intended originally. Since it is the composition compounded after carrying 



out aspect conversion so that the pixel aspect ratio of each picture may become 
almost equal, the image compositing means should just choose whether which 
image data for every pixel is only taken, and can attain simplification of the 
composition of an image compositing means. 

[0028]By using the aspect ratio conversion method of composition of changing 
15 dots into 14 dots, For example, by the screen aspect ratio 4:3 specified by 
REC601 standard of CCIR 711 dots wide and 487-dot-long image data (pixel 
aspect ratio 1.072 when it displays on the monitor of a computer), It is 
convertible for 664 dots wide and 487-dot-long image data (pixel aspect ratio 
1.001) by the screen aspect ratio 4:3. In this case, from 15 dots, since an aspect 
ratio conversion method is comparatively simple composition of conversion to 14 
dots, it can realize an aspect ratio conversion method cheaply with simple 
composition. The error of the aspect ratio to the pixel aspect ratio 1 .0 which the 
computer graphics side assumes is only 0.1%, and does not produce a problem 
at all on vision. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 



[Drawing 1]The block lineblock diagram of the image compositing device 
concerning this invention 

p 3 : X.; .The block lineblock diagram showing one example of an aspect ratio 
conversion method 

] The explanatory view showing operation of an aspect ratio 
conversion method 

g 4]The block lineblock diagram of the conventional image compositing 

device 

[Description of Notations] 

1 -- An image compositing device, 2 - Computer graphics playback equipment, 
2a -- Computer graphics data, 3 -- Video playback equipment, 3a -- Dynamic 
image data, 4 -- Aspect ratio conversion method, The dynamic image data, 5 by 
which 4a-- aspect ratio conversion was carried out ~ An image compositing 
means, 5a - Picture complex data output, 6 ~ A D/A converter, 7 ~ A monitor 
display device, 8 - Reference clock generating circuit, 9 -- A PLL circuit, 10 - A 
delay means, 10a - Delayed computer graphics data, 41 [ ~ A FIFO writing 
control part, 44 / - FIFO reading control part. ] -- An aspect ratio converter, 41a 
- A start signal, 42 ~ FIFO (image data temporary storage means of first-in 
first-out composition), 43 



